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© A method and an apparatus for inspecting a 
three-dimensional surface shape and pattern of an 
object (1) under inspection by images of the surface 
of the object, said images being formed by reflected 
light rays from the object illuminated by lights. The 
surface of the object is illuminated by first (3) and 
second lights (4) provided on the inspected surface 
side of the object and at different heights from the 
object, images of the reflected light rays from the 
surface of the object illuminated by the first and 
second lights (3.4) are acquired by an imaging unit 
(5). a first image of the surface of the object illumi- 
nated by the first light and a second image of the 
surface of the object illuminated by the second light, 
both acquired by the imaging unit, are input sepa- 
rately, brightness values at the same pixel points of 
the first and the second images are subjected to a 
division process to obtain a value, and by using this 
value as the brightness value of the pixel, a third 
image is formed which is used for quality evaluation. 
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BACKGROUND OF THE INVENTION 

This invention relates to a nnethod and an ap- 
paratus for inspecting a surface shape and pattern 
of an object, and more particularly to a method and 
an apparatus for inspecting a three-dinnensional 
shape and pattern of the surface of an object. 

As examples of an apparatus for inspecting a 
three-dimensional shape and pattern of the surface 
of an object, apparatuses for inspecting the sol- 
dered condition of an electronic part after the elec- 
tronic part has been mounted on a board are 
described in JP-A-61 -293657 (literature (1)). and "A 
Tiered-Color Illumination Approach for Machine In- 
spection of Solder Joints", David W. Capson and 
Sai-Kit Eng. IEEE Transactions on Pattern Analysis 
and Machine Intelligence, Vol. 10, No. 3, May 
1988. pp. 387-393 (literature (2)). 

In literature (1), a solder joint under inspection 
is illuminated sequentially from a plurality of an- 
gles, the features such as shapes of highlight pro- 
duced by regular reflection of illumination are ex- 
tracted in binary form from the images obtained by 
illumination from the different angles, and the sol- 
der joint is judged whether or not it is acceptable 
from total assessment of the features obtained from 
the respective images. To switch over iHumination 
from the plurality of angles, a shutter mechanism is 
used or monochrome LEDs which can be switched 
at high speed are used. 

In literature (2), the solder joint is illuminated 
by two high-angle and low-angle lights of different 
emission frequencies, and from images obtained 
by illumination from different angles, the solder 
joint is judged whether it is acceptable or not. 

SUMMARY OF THE INVENTION 

However, in any of the prior art techniques 
mentioned above, no consideration is given to the 
diversity of the luster condition of the solder sur- 
face. Specifically, the solder surface may be tike a 
mirror surface or frosty depending on the kind of 
solder even just after the soldering is finished. 
Generally, even the solder joint with a mirror-like 
surface will have a frosty appearance with passage 
of time, in the manufacturing process of printed 
circuit boards (FOB), substances, such as flux, 
which can be the cause of contamination on the 
solder surface. Therefore, it is difficult to uniquely 
decide an optimal binary threshold to optimally 
extract the soldered condition from solder images 
acquired under fixed illumination. 

In other words, when the solder surface be- 
comes frosty or stained, the reflectance of illumina- 
tion from the lights to the camera is reduced, and 
therefore, the intensity of even a regular-reflection 
light decreases. As a result, the surface shape of 



the solder joint cannot be detected accurately. 

For this reason, it is necessary to adjust a 
binary threshold for binary digitization of images 
from the camera owing to differences in the solder- 

5 ing process, the RGB manufacturing process and 
the kind of solder. The turn-on and turn-off oper- 
ations of the lights, which run to a great number of 
times to control the illumination, affect the service 
life of the shutter mechanism. The monochrome 

70 LED is superior in the high-speed switching perfor- 
mance and the service life, and suitable for the 
solder joint inspection. In inspection of electronic 
parts, polarity markers, etc. other than the solder 
joint inspection, there is a possibility that inspection 

75 becomes difficult owing to the relation between the 
wavelengths of the marker color and the source of 
illumination. 

This invention has been made to solve the 
above-mentioned problems of the prior art tech- 

20 niques, and has as its object to provide a method 
and an apparatus capable of insepcting the three- 
dimensional shape and pattern of the surface of an 
object in a stable and simple manner regardless of 
the surface condition of the object. 

25 According to an aspect of this invention, to 

achieve the above object, there is provided an 
apparatus for inspecting the surface shape and 
pattern of an object, which comprises first and 
second lighting units, provided on the inspected 

30 surface side of an object and at different heights 
from the object, for illuminating the surface of the 
object; an imaging unit for acquiring an image of 
lights reflected from the surface of the object illu- 
minated by the first and second lighting units; an 

35 input unit for accepting a first image of the surface 
of the object illuminated by the first lighting unit 
and a second image of the surface of the object 
illuminated by the second lighting unit; and a unit 
for performing a division process between bright- 

40 ness values at the same pixel points of the first and 
second images accepted by the input unit and 
forming a third image by using a value derived 
from said division process as the brightness value 
at the pixel. 

45 In this invention, multiple, for example, two 

lights are provided at different heights from the 
object being inspected and on the surface side of 
the solder joint of the object on a circuit board. 
Under the above-mentioned arrangement, the 

50 flat area of the solder joint illuminated by the upper 
light gives back lots of regular-reflection light and 
the inclined area of the solder joint illuminated by 
the lower light throws back lots of regular-reflection 
light. By performing a division process between the 

55 brightness values at the same pixels of the images 
by the upper and lower lights, a ratio of reflection 
of illumination by the upper and lower lights can be 
obtained. From this ratio, how much the solder 
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surface is inclined can be known. Because not the 
intensity of the reflected light but the ratio is used, 
the degree of the inclination of the solder surface 
can be evaluated regardless of the variation of the 
reflecting condition of the solder surface. There- 
fore, the presence or absence of solder, insufficient 
solder, solder bridge, etc. can be detected with 
high reliability. 

When lamps with different wavelengths of light 
are used, an illumination arrangement can be ob- 
tained which has a wide range of wavelengths 
close to natural light. This makes it possible to 
clearly observe electronic parts, polarity markers, 
etc., for example, other than the older joints. 

Thus, automatic inspection of solder joints can 
be realized. By using an optical system according 
to this invention, polarity markers, etc. can be in- 
spected . 

BRIEF DESCRIPTION OF THE DRAWINGS 

Fig. 1 is a diagram showing a whole arrange- 
ment as an embodiment of an apparatus for 
inspecting the soldered condition of electronic 
parts according to this invention; 
Fig, 2A is a sectional view of an example of a 
solder joint as an object of inspection; 
Figs. 2B, 20 show examples of images obtained 
by illuminating a solder joint of the inspected 
object with upper and lower lights 3, 4; 
Fig. 3A is a diagram showing the relation be- 
tween positions of the lights of the optical sys- 
tem of Fig. 1 and the reflected light from the 
solder joint to a camera; 

Fig. 3B is a side view of a modification of the 
optical system used in the embodiment of Fig. 
1; 

Fig. 4 is an example of image obtained by a 
division process between images of Figs. 2B, 
20; 

Figs, 5A, 50, 5E, 5G are side views showing 
soldered conditions of parts; 
Figs. 5B, 5D, 5F, 5H show images obtained by a 
division process between images of solder joints 
of Figs. 5A, 50, 5E, 5G; 

Figs. 6A, 60 are plan views of solder joints with 
a bridge and with no bridge; 
Figs. 6B, 6D are diagrams showing the bright- 
ness in the directions of arrows A. A* in the 
images obtained by division processes in the 
windows of Figs. 6A, 60; 

Fig. 7 is a block diagram showing an arrange- 
ment of the image processing unit and the con- 
trol unit of Fig. 1; 

Fig. 8 is a flowchart for explaining the operation 
of the devices of Fig. 7; 

Fig. 9 is a flowchart for explaining the decision 
process about a bridge; 



Fig. 10 is a bottom view showing an example of 
an illumination arrangement of Fig. 1 ; 
Fig. 1 1 shows an example of the optical system 
arrangement in another embodiment of this in- 
5 vention; 

Fig. 12 shows an example of the optical system 
arrangement in still another embodiment of this 
invention; and 

Figs, 13A, 138 are diagrams showing the rela- 
10 tion between the division-derived image values 
and the inclination of the surface of the object 
being inspected. 

DESORIPTION OF THE PREFERRED EMBODI- 
75 MENTS 

Preferred embodiments of this invention will be 
described in detail with reference to the accom- 
panying drawings. In the drawings, the same refer- 

20 ence numerals designate the parts having the 
same functions. 

As a preferred embodiment of this invention, 
description is made of an apparatus embodying 
this invention for automatically inspecting the sol- 

25 dered condition of electronic parts after they have 
been mounted on a POB. 

Fig. 1 shows an arrangement of a soldered 
condition inspection apparatus embodying this in- 
vention as described. Reference numeral 1 indi- 

30 cates a POB under inspection which has electronic 
parts mounted and soldered thereto. The POB un- 
der inspection is placed on an X-Y table and is 
moved according to an inspection sequence to be 
described later. Lights 3, 4 are used to illuminate 

35 the POB 1. For example, circular lights are moun- 
ted coaxially at upper and lower positions as shown 
in Fig. 1. Reference numeral 5 indicates an imag- 
ing device such as a TV camera using a OOD 
(charge-coupled device), and the imaging device 

40 detects an optical image of that inspected part of 
the POB which is illuminated by the lights 3, 4, and 
inputs an acquired video signal into an image pro- 
cessing unit 6. The position control of the X-Y table 
2 and the ON/OFF control of the lighting units 3, 4 

45 are performed by a controller 7. 

Figs. 28. 20 show images obtained by illu- 
minating the solder joint inspection of the POB with 
the upper and lower lights 3, 4. Fig. 2A is a 
sectional view of the solder joint under inspection. 

50 In the sectional view of Fig. 2A. reference numeral 
10 indicates an electronic part, 11 the solder, 12 an 
electrode of the electronic part, and 13 a soldering 
pad on the board. Images are acquired as a train of 
electrical pulses representing the light intensities. 

55 However, for the sake of simplicity, in Figs. 2B, 20, 
in the solder joint, the white areas a indicate the 
brightly illuminated areas by lighting, while the 
hatched areas b indicate the relatively dark areas. 
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It is understood from Figs. 2B, 2C that the way of 
reflection of light varies between the upper light 3 
or the lower light 4. This is because the solder 
surface inclination at which a regular reflection of 
illumination occurs differs between the upper and 
lower lights. More specifically, as is clear from the 
side view in Fig. 3A of the optical system (3, 4, 5) 
of Fig. 1. when the solder joint is illuminated by the 
upper light 3, the reflected light rays are stronger if 
the solder surface is flat, and when the solder joint 
is illuminated by the lower light 4, the reflected 
light rays are stronger if the solder surface is 
inclined. The installed position of the upper and 
lower lights 3, 4 can be selected arbitrarily. How- 
ever, due to the conditions shown in Fig. 3A, as the 
illumination light from the upper light 3 becomes 
closer to vertical and as the illumination light from 
the lower light 4 becomes closer to horizontal, 
images change greatly by different inclinations of 
the solder surface. 

As a countermeasure, as shown in Fig. 3B, in 
place of the ring light 3, it is possible to provide a 
half mirror or a cube beam splitter 8 right below 
the camera 5 at the same height as the position of 
the light 3, and also, a spot light 3a for emitting a 
spot beam parallel with the board 1 to emit a light 
beam from right above a part 10a being inspected. 
The lower light 4 Is disposed at a height where the 
light 4 will not come into contact with another part 
10b on the board 1. 

It is also possible to obtain the geometric fea- 
tures of highlights by regular-reflection light beams 
in the form of binary data, for example, -by using 
two Images shown in Fig. 2 and make a accept- 
reject decision on the solder joint by a total exami- 
nation of the features acquired from those images. 
In view of a variety of the luster condition of the 
solder surface and the contamination of the solder 
surface by flux in the manufacturing process of 
PCBs, it is considered likely that there will be some 
effects on the reliability of inspection if an optimum 
binary threshold is decided uniquely to optimally 
extract the solder condition from solder-joint im- 
ages captured under illumination of the fixed lights. 
To avoid this problem, this invention uses a meth- 
od of dividing data on an image 8 by the upper 
light in Fig. 2B by data on an image 9 by the lower 
light in Fig. 2C. Let coordinates in an image be (I, 
J); let the brightness value of a pixel point (I, J) in 
an image 8 by the upper light be UPIC(I.J); and let 
the brightness value of a pixel point (1, J) in an 
image 9 by the lower light be DPIC(I,J). Suppose 
that the brightness is expressed in 256 stages. If 
UPIC(I.J) is larger than DPIC(!,J), an image value 
DVDPIC{t,J) obtained by division as described is 

DVDPIC(I,J) 

= 128 + [{UP!C{1.J)/DPIC{I,J)} - 1] X C (1) 



If UPIC(I.J) is smaller than DPIC(I,J). 
DVDP1C(I,J) 

= 128 - [{DplC(I,J)/UplC(IJ)} - 1] X C (2) 

5 

If the calculation result of DVDPIC(I,J) is less 
than 0, DVDPIC is made 0. And, if the calculation 
result is 256 or more, DVDPIC is made 255. In 
Eqs. (1) and (2), the constant C is any natural 

70 number. Supposing C is 30, if UPIC(I.J) is twice 
DPIC(I,J), that is, if the brightness value is twice 
higher for UPIC(I.J), DVDPIC is 158. In addition, if 
the brightness value is three times or four times 
higher, DVDPIC Is 188 or 218. Conversely, if DPIC- 

75 (I, J) is twice or three times higher than UPIC(I,J), 
DVDPIC{I,J) is 98 or 68. In other words, the con- 
stant C serves a kind of amplification factor in 
developing the ratio of UPIC(1,J) to DPIC(!,J) on the 
gray scale in expressing the gradation of bright- 

20 ness of the image. To be more specific, if the value 
of C is made large, a slight variation in the inclina- 
tion can be displayed with the value of DVDPIC(U) 
centering round 128, but a conspicuously inclined 
area and a flat area of the solder joint are hard to 

25 be displayed. If the value of C is made small, an 
image of the inclined area with DVDPIC(I,J) of 
about 128 becomes rough. An image 14 of Fig, 4 is 
an example of result of processing two images of 
Figs. 2B, 2C by Eqs. (1) and (2). In this case, the 

30 obtained values of the ratio are divided into three 
stages, for example, the area with the smallest ratio 
is expressed in white, the area with the intermedi- 
ate ratio in gray, and the area with the largest ratio 
in black. 

35 Specifically, the light (white) area corresponds 

to the flat area of the solder joint, and the dark 
(cross-hatched or black) area corresponds to the 
inclined area. The luminance of the intermediate 
(hatched or gray) area c indicates the intermediate 

40 area between the flat area and the inclined area. If 
the solder surface is completely like a mirror sur- 
face, the brightness of the solder surface exces- 
sively changes depending on whether or not there 
is a regular reflection of illumination from 'the upper 

45 and lower lights. Therefore, the values of DVDPIC 
obtained by Eqs. (1) and (2) will agglomerate in 
three groups: inordinately large or small or values 
close to 1 28. However, when the solder surface has 
some irregular-reflection components by its frosty 

50 or contaminated surface condition, even if the in- 
clination of the solder surface is not in the con- 
dition of regular reflection, light rays are reflected 
also in the area surrounding the area so inclined as 
to cause regular reflection. The quantity of re- 

55 fleeted light rays greatly changes according to the 
condition of the solder surface. Generally, the 
quantity of reflected light rays decreases still less 
as the inclination of the solder surface deviates 
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from the angle at which regular reflection occurs. !n 
this case, the values of DVDPIC obtained by Eqs. 
(1) and (2) spread in the range from 0 to 255. The 
larger the value of DVDPIC, that is, the brighter the 
image 14, the flatter the solder surface is. Con- 
versely, the smaller the value of DVDPIC, that is, 
the darker the image 14, the more conspicuously 
inclined the solder surface is. 

In this invention, a ratio of the quantities of 
reflected light at the same pixel is examined when 
an object being inspected is illuminated by two 
lights 3 and 4, and therefore, the degree of the 
inclination can be evaluated regardless of absolute 
quantities of reflected light, that is to say, regard- 
less of the solder surface condition. In the follow- 
ing, brief description will be made of an example in 
which this invention is applied to inspection of 
solder joints of parts mounted on a PCS. A 
division-derived image obtained as a result of di- 
vision process is a gray scale image in which the 
brightness varies continuously according to the ra- 
tio DVDPIC. A threshold process is performed to 
divide an image into areas corresponding to flat 
and inclined areas of a solder joint. As is clear from 
Eqs. (1) and (2), a pixel where a division-derived 
image value is larger than 128 can be considered 
to correspond to a flat area of the solder joint and a 
pixel where a division-derived image value is small- 
er than 128 will correspond to an inclined area of 
the solder joint. For the neighborhood of 128 where 
there is a transition region between the flat and 
inclined areas, an adequately selected margin M is 
provided for the transition region, the region is 
divided into a flat area of greater than (128 + M) 
and an inclined area of smaller than (128 - M), and 
the area from (128 - M) to (128 + M) may be 
neglected and may not be displayed. If such a 
division is made, when the solder joints of elec- 
tronic parts mounted on a PCB shown in Figs. 5A, 
SB, 5C, 5E, and 5G are subjected to an accept- 
reject decision, their images are as shown in Figs. 
SB. 5D, 5F, and 5H. In Figs. 58, 5D. 5F, and 5H, 
the flat areas are expressed in white and the in- 
clined areas are indicated by hatching. Incidentally, 
for gray-scale display, the values from above-men- 
tioned divisions may be classified into three or 
more stages. 

Fig. 58 shows a division-derived image of a 
normal condition of a solder joint. For soldering 
defects, such as no solder and insufficient solder, 
as shown in Figs. 5C, 5D, a length L of the flat 
solder area from the end of the solder pad is 
measured along the center line of the solder joint, 
and when the length L is longer than a fixed value, 
this may be judged to be no solder or insufficient 
solder. In excess solder shown in Figs. 5E, 5F or 
poor wetting due to insufficient solder in Figs. 5G, 
5H, the solder is laid in a convex form on the 



solder pad, and in a division-derived image, the 
area close to the top is flat and therefore, light and 
surrounded by the dark area, which is the inclined 
area. So, a check is made of the solder joint to see 

5 if there is an isolated segment as indicated by a in 
Figs. 5E, 5H. If there is such a segment, you have 
only to judge if to what extent the segment a is 
surrounded by the dark area of the inclined area. 
An example of a method of detecting a solder 

70 bridge will next be described. Figs. 6a, 68 show 
plan views indicating a normal condition (no bridge) 
and an occurrence of a solder bridge which are 
observed through an inspection window 15 set at 
intermediate regions between electronic parts and 

75 also show images obtained as a result of a division 
process between images within the window. 
Graphs of Figs. 68, 6D show changes in brightness 
of division-derived images in the directions A and 
A' in the windows as shown above in the figures. 

20 The F of the graphs represents values of bright- 
ness. Normally, in division-derived images obtain- 
able by this method, the circuit board surface or 
the like are picked up as a flat area, in other words, 
the reflected light rays from the circuit board are 

25 strong. Needless to say, the reflectance differs 
among the board surface, wiring pattern and print- 
ed characters, so that the values of DVDPIC in Eq. 
(1) for those areas differ. However, in any case, the 
reflected light rays by the upper light are stronger, 

30 so that it is evident that the values of DVDPIC are 
larger than 128. Even so, if a bridge is formed in 
such places mentioned above, the brightness at 
such a place fluctuates by the presence of solder, 
and therefore, the values of DVDPIC become less 

35 than 128 at the inclined areas on both sides of the 
bridge. As a result, if these changes are detected, 
it is possible to judge whether or not there is 
solder. Figs. 6A, SB schematically show the cases 
where a solder bridge is present and absent. 

40 Fig. 7 is a block diagram showing examples of 

the arrangement of the image processing unit 6 
and the controller 7 shown in Fig. 1 . A central 
processing unit (CPU) 21 included a read only 
memory (ROM) and a random access memory 

45 (RAM). The operation of the arrangement in Fig. 7 
will be described with reference to a flowchart of 
Fig. 8. 

CPU 21 issues a positioning command through 
a bus 22 to an X-Y table driving circuit 28 in the 

50 controller. In response to this command, the driving 
circuit 28 gives a drive signal to the X-Y table 2 to 
drive the X-Y table to position a part under inspec- 
tion right below the camera 5 (step 802). 

Then, CPU 21 issues a lighting command 

55 through the bus 22 to a light on/off control circuit 
26 to turn on either one of the lights 3, 4, the light 
3, for example (step 804). In response to this 
command, the light on/off control circuit 26 sup- 
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plies a lighting current to the light 3 to turn it on. 

The CPU 21 issues a command to an innage 
input circuit 16 to accept an image of a solder joint, 
illuminated by the light 3, which has been picked 
up by the camera 5. As a result, the image Input 
circuit 16 accepts image data for one frame from 
the camera 5, and converts the image data into 
digital signals by a built-in analog-to-digital (A/D) 
converter. The CPU 21 issues a store command to 
an image memory 17, which accordingly stores 
image data for a frame in digital form (step 806). 
The CPU 21 issues an extinguishing command 
regarding the light 3 to the light on/off control 
circuit 26, which accordingly cuts off the lighting 
current to the light 3 to turn it off (step 808). The 
CPU 21 then issues a lighting command to turn on 
the light 4 to the light on/off control circuit 26 (step 
810), and after the light 4 turns on, issues a com- 
mand to store images made by illumination of the 
light 4 for forming a frame to the image input 
circuit 16. After accepting those images, the image 
input circuit 16 converts the image data into digital 
form, and in response to a command to store 
image data in the image memory 18, the image 
memory 18 stores the digital image data for for- 
ming a frame (step 812). 

The CPU 21 issues an extinguishing command 
to the light on/off control circuit 26 to turn the light 
4 off (step 814). Data stored in the image memo- 
ries 17, 18 are values representing the brightness 
of the inspected area of the same object under 
inspection illuminated by the lights 3, 4. 

The brightness values UP1C(I,J) and DPIC(l.J) 
at a pixel at the same position in the image are 
read out, are subjected to a division process by a 
divider 19 using Eq. (1) or (2) (step 816), and a 
resulting value DVDPlC(l.J) is stored in an image 
memory 20 (step 818). The process of steps 816 to 
818 is performed for all pixels, where a division 
process needs to be executed, of images stored in 
the image memories 17, 18. 

Data in the image memory 20 may be divided 
into a plurality of areas and may be displayed on a 
display device, a CRT 24, for example, by the 
gradation of brightness according to the division 
made as shown in Figs. 4, 5, etc. (step 820). 

As shown in Fig. 5D, it is possible to let the 
CPU 21 calculate the length L of the flat solder 
area from the end of the solder pad along the 
center line of the solder joint from data in the 
image memory 20 (a length or the number of 
pixels which conform to the range of (D\/DPIC(I,J) 
^ (128 + M)) where DVDP1C(I,J) derived from the 
division process corresponds to the displayed con- 
tinuous white area in the X-direction from the right 
end of the window, for example), and judge the 
solder to be unacceptable if the length L is greater 
than a fixed value, and notify the judgment result 



by displaying on the CRT 24 or by sounding an 
alarm buzzer (not shown) (step 814). 

Fig. 9 is a flowchart showing a decision pro- 
cess about a bridge shown in Fig. 6C. Data at the 

5 same pixel in a specific image area (an area cor- 
responding to the window 15 in Fig. 6C) in the 
image memories 17, 18 is read out and subjected 
to a division process using Eq. (1) or (2) (step 
902). and the process result DVDP1C(I,J) is stored 

w in the image memory 20 (step 904). The division 
process is performed for data at all pixels and the 
results are stored in the image memory 20. A 
decision is made whether or not there is any 
DVDP1C(I,J) in the image memory 20 that is less 

15 than 128. If there is not, a decision that there is no 
bridge is made, and displayed on the CRT (steps 
906, 910). If there is, a decision that there is a 
bridge is made (steps, 906, 908), and the decision 
result is displayed on the CRT (step 910). 

20 Figs. 8, 9 show examples of a decision process 

about the solder condition, and other decision pro- 
cesses may be used to make an accept-reject 
decision. 

In Fig. 7, RAM in the CPU 21 may be used for 
25 the image memories 17. 18, and the division pro- 
cess in the divider 19 may be performed in the 
CPU 21. 

Fig. 10 shows an example of the arrangement 
of the light 3 or 4 shown in Fig. 1 as seen from 

30 below. To input images by the upper and lower 
lights at high speed, it is necessary to perform 
switching of the lights at high speed. So, as shown 
in Fig. 10, a plurality of circular luminous elements, 
light-emitting diodes (LED) for example, are ar- 

35 ranged. If LED lamps of the same wavelength are 
used, there is no problem so long as solder joints 
are inspected. However, in inspection of electronic 
parts or polarity markers, inspection will, in some 
cases, become difficult owing to the relation be- 

40 tween wavelengths of the marker color and the 
light source. To solve this problem, as shown in 
Fig. 10, LEDs with different wavelengths may be 
mixed to form a light. In Fig. 10, LED lamps 33 are 
near-red. LED lamps 34 are green, and LED lamps 

45 35 are yellow, for example, and those lamps may 
be arranged regularly in a circle. By assorting 
LEDs of different wavelengths to form a light, it is 
possible to obtain a light having a wide range of 
wavelengths close to natural light, and perform 

50 high-speed switching. 

In the embodiment of Fig. 1, the upper and 
lower lights are switched over and images by the 
upper and lower lights are obtained alternately. 
However, it is possible to use upper and lower 

55 lights of different emission frequencies (or frequen- 
cy bands), and obtain images by the upper and 
lower lights through two kinds of filter mounted in 
the camera. More specifically, as shown in Fig. 11. 
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upper and lower lights 3, 4 of emission frequencies 
(frequency bands) fa, U are used, two cameras 5a 
and 5b are arranged close to each other, and filters 
30a, 30b respectively allowing only frequencies fa, 
f^ to pass. Then, it is only necessary to give a 
command from the CPU 21 to the image input 
circuit 16 to accept images from the cameras 5a, 
5b alternately. 

Therefore, in this case, the lights 3, 4 may be 
formed respectively by connbining LEDs of multiple 
emission frequencies. 

In the foregoing embodiments, the lights are 
provided in two stages, but they may be provided 
in three or more stages. An embodiment in such a 
case will be described with reference to Figs. 12. 
13. Fig. 12 shows an arrangement of the optical 
system in this embodiment. Ring lights 51 to 54 
are provided in four stages, and the lights are 
arranged coaxially with respect to a line 60 con- 
necting between the camera 5 and the object 10 
being inspected. The inclinations formed by the 
lights 51 to 54 and the object 10 are denoted by 
a1, a2, a3, and a4. By alternately turning on and 
off the lights 51, 53, a division-derived image value 
DVDPIC(I,J) at a pixel point (I.J) is calculated by 
using Eq. (1) or (2) mentioned above using the 
same method as in the embodiment described 
above. Here, this division-derived image value is 
represented by DVD(51/53). If the division-derived 
image values are classified into three ranges: more 
than, (128 + M), less than (128 - M) and a range 
between (128 + M) and (128 - M) as in the 
foregoing embodiments, the relation between the 
inclination 0 of the surface of the object 10 with 
respect to the board surface 1 and the division- 
derived image value is shown in Fig. 3A. In Fig. 3A, 
the ranges 80, 81, 82 are a range where DVD- 
(51 '53) is more than 128 + M, a range where 
DVD(51/53) is between 128 + M and 128 - M, and 
a range where DVD(51/53) is less than 128 - M. 
Therefore, the inclination /3 can be measured from 
the minimum a1 to the maximum a3. 

Likewise, by turning on the lights 52, 54, .the 
division-derived image value DVDP1C(I,J) (here ex- 
pressed as D\/D(52/54) at a pixel point (I.J) is 
calculated by using Eq. (1) or (2). If division-de- 
rived image values are classified into three ranges 
as in the above-mentioned embodiments, the 
ranges 85, 86, 87 are a range where DVD(52/54) is 
more than 128 + M, a range where DVD(52/54) is 
between 128 + M and 128 - M, and a range where 
DVD(52/54) is less than 128 - M. and therefore, the 
inclination ^ can be a2 to oc4. 

If a small value is used for the value of M, the 
ranges are set according to the values of DVD- 
(51/53) and DVD(52/54) as shown in Fig. 13B. 
Therefore, it is possible to easily understand to 
which of the eight ranges 90 to 97 the inclination j3 



at the pixel point (I, J) belongs. For example, if the 
value of DVD(51/53) at a pixel point (I.J) belongs to 
the range 82 and the Value of D\/D(52/54) at the 
same pixel point belongs to the range 85, it is 

5 found that the inclination 13 belongs to the range 
93. In a gray-scale display over the ranges 90 to 
97, if the range 90 is expressed in white, the range 
97 is expressed in black representing an inclination 
steeper than a4 and the ranges from 91 to 96 are 

70 expressed in dark gray, gray-scale display can be 
made for each pixel point according to the degree 
of the inclination 0. 

For combinations of lights for a division pro- 
cess, combinations of lights 51, 52 or 53, 54 other 

15 than those mentioned above may be used. 

According to the embodiments mentioned 
above, the degree of the inclination of the solder 
surface can be expressed on an image based on 
gray-scale values. This method makes it possible 

20 to inspect the shape of the solder joints without 
being affected by the frosty or contaminated ap- 
pearance of the solder surface. In addition, this 
method enables solder joint inspection to be auto- 
mated, so that the required labor can be reduced in 

25 the soldering process. 

The apparatus according this invention is ca- 
pable of not only inspecting the degree of the 
inclination, namely, the three-dimensional shape 
and pattern of the solder surface but also can be 

30 easily applied to inspection of the three-dimen- 
sional shape and pattern of other objects. 

In this invention, the division-derived image val- 
ues are displayed by gray-scale expression, but 
may be displayed in different colors. 

35 

Claims 

1. An apparatus for inspecting a surface shape 
and pattern of an object, comprising: 

40 first and second lighting means (3, 4), pro- 

vided on the inspected surface side of an 
object and at different heights from the object, 
for illuminating the surface of the object; 

imaging means (5) for acquiring images of 

45 lights reflected from the surface of the object 

illuminated by the first and second lighting 
means; 

input means (16) for accepting a first im- 
age of the surface of the object illuminated by 

50 the first lighting means (3) and a second image 

of the surface of the object illuminated by the 
second lighting means (4), said first and sec- 
ond images being captured by said imaging 
means (5); and 

55 means (19, 20) for performing a division 

process using brightness values at the same 
pixel points of the first and second images 
accepted by the input unit (16) and forming a 
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third image by using a value (DVDPIC) derived 
from said division process. 

An apparatus according to Claim 1 , wherein 
each of said first and second lighting means 5 
(3, 4) comprises means for emitting light rays 
with multiple different wavelengths. 

An apparatus according to Claim 1. further 
comprising means (7) for classifying brightness io 
values at each pixel of a third image formed by 
said third image forming means (19, 20), as- 
signing different colors to the respective 
classes and displaying each pixel of said third 
image in a color according to the brightness 15 
value at the pixel. 

An apparatus according to Claim 1 , wherein 
there is further provided light on/off control 
means (21, 26) for turning on and off said first 20 
and second lighting means (3, 4) alternately, 
and wherein said input means (16) comprises 
means for alternately accepting the first and 
second images captured by said imaging 
means (5) in synchronism with on/off control 25 
by said light on/off control means. 

An apparatus according to Claim 1, wherein 
frequency bands of the illumination tight of 
said first and second lighting means (3. 4) are 30 
different first and second frequency bands, and 
wherein said imaging means includes image 
pick-up means (30a. 30b) for separately ac- 
quiring reflected light rays of said first and 
second frequency bands. 35 

An apparatus according to Claim 1, wherein 
said apparatus is adapted to inspect the con- 
dition of solder joints of parts mounted on a 
printed circuit board. 40 

A method of inspecting a surface shape and 
pattern on the surface of an object, comprising 
the steps of: 

providing first and second lighting means 45 
(3, 4) on the inspected surface side of an 
object and at different heights from the object 
for illuminating the surface of the object; 

acquiring images of reflected light rays 
from the surface of the object illuminated by so 
said first and second lighting means; 

separately inputting a first image of the 
surface of the object illuminated by the first 
lighting means (3) and a second image of the 
surface of the object illuminated by the second 55 
lighting means (4); and 

forming a third image by using a value 
derived from the division process as the bright- 



ness value of a given pixel, said third image 
being obtained by performing a division pro- 
cess between brightness values of at the same 
pixel points of the first and second images. 

8. A method according to Claim 7. further com- 
prising the step of causing the first and the 
second lighting means (3. 4) to respectively 
emit light rays with multiple different 
wavelengths. 

9. A method according to Claim 7, further com- 
prising the steps of classifying a brightness 
value at each pixel of said third image formed 
by the step of forming said third image into a 
plurality of ranges, assigning different colors to 
the respective classes and displaying each 
pixel of said third image in a color according to 
the brightness value at the pixel. 

10. A method according to Claim 7, further com- 
prising the steps of alternately turning on and 
off the first and second lighting means (3, 4) 
and alternately inputting the first and second 
images acquired. 

11. A method according to Claim 7, further com- 
prising the step of separating frequency bands 
of the illumination light by the first and second 
lighting means (3, 4) into different first and 
second frequency bands, wherein said image 
acquiring step comprises a step of separately 
acquiring images of the reflected light rays of 
said first and second frequency bands. 

12. A method according to Claim 7, wherein said 
method is adapted to inspect the condition of 
solder joints of parts mounted on a printed 
circuit board. 
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